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A FIR filter device for flexible up- and downsampling 



10 



15 



20 



25 



The invention relates to a Finite Impulse Response (FIR) filter device for 
sample rate converting a sequence of discrete representations and to an image display device 
including such a filter device. 



WO 98/19396 discloses a direct form, transposed form and combined FIR 
filter. Fig. 1 shows a representation of the known direct-form Finite Impulse Response (FIR) 
filter. The structure is output based. It incorporates an input pipeline IP with input delay cells 
DI, The input pipeline has a sequence of tap points TP,. An input tap point TP* is provided at 
least between each sequential pair of input delay cells DI S and DI i+1 and an input tap point is 
added after the last delay cell. An output line of the filter supplies a sequence of output 
discrete representations. The output line includes a plurality of summating elements S, for 
adding at least two discrete representations. The discrete representation is, typically, a sample 
such as a video pixel. Taps Ti couple a respective input tap point TP, to a corresponding 
summating element S, Each tap Ti includes a respective multiplier M s for multiplying a 
discrete representation from the input pipeline by a coefficient The delay cells ensure that 
the multipliers operate on a set of successive input samples in one clock cycle. The 
multipliers can multiply an input sample with a filter value reflected by the coefficient fed to 
the multiplier (not depicted here). In the example of Fig. 1, four input samples can contribute 
to one output sample. In a situation where for each input sample an output sample is 
generated this enables filtering with a footprint (or filter width) of four samples. This filter 
structure is also capable of scaling an input signal. An example is up-scaling of a video signal 
where a line of video output samples contains more samples than the input line. To this end, 
the filter is driven by the output clock. By operating on the same input samples during more 
than one cycles more output samples than input samples are produced (i.e. the signal is up- 
scaled). Shifting of the input samples through the input delay cells is controlled by an input 
enable signal (no shown). For up-scaling, during some output clock cycles shifting of the 
input is disabled. When the input smfting is disabled, it is still possible to supply other 
coefficients to the multiplexer. In this way, successive output samples derived from the same 
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group of input samples can be different « . c. • 3 1 .03.200 

Inprinciple, the filter can also ZTf 7 " X " »»- 

5 ove^ this, more J^TL ^ ° f *° To 

10 ofou^tdebyeeDsDCandDOwisasun™^ , SeqUe ° tiaI 

etching netwoftOSN for accurnulanng output values JLlZ 

^ an unduplie* operate oa a ^ ^"^,7 ? SUmmatm8 * 

optaal for do™ scaling, where the filter is driven by the taTTT * " 

m qualny up scaling, unless more multipliers/addets/delays were added 

Tob ^We to deal wim different scaHng requirements W098/191Q* , 
showsafflterthatisacombmationofmedescrihpHH * T ^° 
co m bmedmter,themul ti pner S are s rrd ^ ^ ^ ^. In the 
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Wrth the imroduction of 16:9 televidoI1 ^ ^ ^ 
aspect ratio, brgh quamy display of m „ ^ more t c 'j' 

I' 6:9 *— °— ' ^ — ta wide taees which was unalptL 
" ^ ^ *> « — -ode. In mis modCt^ 

-flayed m tire center of the sct.cn ™ not up-scaled . ^ ^ ^ . ^ J — ' 
performing such scaling. It was found that even better results were achieved if the center of 
th screen was downscaled (for compensation). Apossib.e seating curve is aparabo,a(a 
^nual of second degree) aUowing both upscale and downscale ratios wiL 0 ,revL 
hn, Using the .reown combined finer surrcreres result in a delay when a change-over 
b^eeudreffl^^duerereerect^^pipe^^^^^^ 

change^needatobere-^edwithd.edesiredsamp.e, Such a delay is undesired for 
stream processing of, for example, video or audio. 



I, is an object of the invention to previde a fiher stiucmre drat is capable of 

hgh-qualny filtering, capable of scaling streamed data, with „ = * 

scaling modes. «med data, with a smooth changeover between 

To meet the object of the invention, the filter device includes- 

" m ^ P ^ efffOT ^^^^««ofdiscreterepresentations 
and including a sequence of input delay cells DI , eaehtx, . • 

andanl.™^ <•»,• TOWy MUs DI » ^ to a*>mg a discrete representation; 

-daplurah^of^ut^pmnta TP, where an inputs pointisprevi ded a. ieast between 
each sequential pah- of input delay cells; east Between 

. . , ""^^'^^^^"^oeofmserererepresenMousand 

££" IT™ ° f ^ ^ "Present; a 

phnrtuy of^sumnnttingelements S, for adding a, leas, two discrete represent, a 

gating element being provided a, .east between each seooentia, pair of ompu, delay 
ecus, and an otnp,* switching network OSN for acennnuating output values Z, me 
summating elements; and 

eachtani , ; 8 °^-^taps.Ti for coupling «he input pipeline to the oWpu, pipeHne; 

12 " reSPeCaVe M ' * mUWPlyi18 * *"~ ™-«on" m an 

« pom, by a coefficient a, leas, 1 of the taps including a swnchmg element for 
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— ing element the switching elements heing ananged to enable supply a discrete 
representation from any tap point TPj to a snmmating element Si, where j <-i 

bomm ein . ^""^ of ^ -ble the filter to access mulupfc elements from 
bom me mpu, p.petoe and me outou, pipeliae sto^^. ^ ^ i( to 

5 mamtem a bigh^ualhy fihering perfo^ ^ ^ a ^ u 

down-scaling or vice versa. s 
According to me measnre of the dependent claim 2, each of me taps T, are 
coupled to only one respective snmmating elements * me switching element SW, being 
prodded in between tap po^ TOfc where j ^ and the multiplier M,. In principie, me 
swttohmg element may afco be located in between me mmtiptiers and the onto* pipeHne 
Tms merely changes lie respective multiplication coefficient out offthe mate Ci 

A< ^8 <° tte measure ofme dependent claim 3, theFTR filter device has a 
contfant filter wtdm N t ^output delay ecus DQ, and *or IV- 1 (depending on if the inmrt 
abeam can be stoUed) input delay ceils D t in mis atrangemen. a filter width ofat least N can 
^ dlm,g t 0 ™*^ «*> when the scaling factor or scaling mode is 

aninn , •, fc A ^ S fe ^ 0fae 4. *e mpm pipeline includes 

an mpu. swrtehmg network tor accumulating input values in the input delay cells Dl, 

enablmg upscaliug in situations where me input stream can no, be temporarily nalted while 
outout samples are generated a, a higher frequency. 

According to me measure of to dependent claim 5, each multiplier Mi is 
assomated with a respective coefficient matrixQto enable poly-phase fijtering 

A< ^8tomemeaaureofmedependemclaim6,mefflterdeviceincludesa 
conquer operative to comrol me fiher device based on a stete machine, m princip,e, many 
settings of me fflter can be changed. Using a stete machine is an eflective way to couteo, I 
scaler settings. 

According to the measure of the dependent claim 7, the state machine 
determines at least one of the following: 

- a setting of the switching elements SWi, 

- a setting of the output switching network, 

- clocking of the input pipeline and/or output pipeline. 
Depending on the functionality of the filter, the state machine also determines 

a selection of a coefficient from the coefficient matrix Q and/or a setting of the input 
switching network. 
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According to the measure of the dependent claim 10, the filter device includes 
a further delay element and a subtracting element for subtracting an input discrete element 
from an immediately preceding input discrete element and supplying an outcome of the 
subtraction into the input pipeline; and including a further summating element for adding the 
nnmediately preceding input discrete element to an output discrete element to be supplied by 
the output pipeline. In this way the filter operates on 'AC values (i.e. on a difference with 
respect to the previous input sample instead of the absolute value). This avoids the so-called 
DC-npple. Such a ripple occurs where the input is more or less constant («DC) and the 
coefficients applied to the filter do not exactly add up to a multipHcation factor of 1, causing 
a small disturbance being added. Where small sequences of constant values are interchanged 
with a different sample value this may result in a visible or in any other way noticeable 
'ripple' in the output signal for the filter. By operating on an offset instead of an absolute 
value, the filter is fed with zero-value samples for sequences of constant sample values. Such 
a sequence will result in a zero output of the multipliers, irrespective of small faults in the 
multiplication factors. The actual input sample is added at the output of the filter. 

To meet an object of the invention, a signal processing apparatus includes a 
FIR filter device as claimed in claim 1 for sample rate converting an input signal, where the 
discrete representation is a sampled input signal, for subsequent rendering by a rendering 
device. 

These and other aspects of the invention are apparent from and will be 
elucidated with reference to the embodiments described hereinafter. 



In the drawings: 

Fig. 1 shows a prior art direct form FIR filter; 

Fig. 2 shows a prior art transposed form FIR filter; 

Fig. 3 shows upscaling using a direct form FIR filter; 

Fig. 4 shows downscaling using a transposed form FIR filter; 

Fig. 5 illustrates a FIR filter according to the invention; 

Fig. 6 shows a first embodiment of the filter; 

Fig 7 shows a second embodiment of the filter; 

Fig. 8 shows a third embodiment of the filter; 

Fig. 9 shows a fourth embodiment of the filter; 

Fig. 10 shows more details of an embodiment of the filter; 
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pipeline; 



Fig. 11 shows the way of indicating which samples are added to the output 

Fig. 12 illustrates ihe states of a four-stage filter; 
Fig. 13 illustrates state transitions for state 2; 
Fig. 14 shows the states and transitions for a four-stage filter; 
Fig. 15 shows the conditions for the transitions and the output; 
Fig. 16 gives an example of a panorama processing of a sample line- and 
Fig. 17 shows a signal processing apparatus including the filter according to 
the invention. B 



10 



15 



20 



25 



30 



To long pipelines of eimer top* or 

Uteres -developed tbrfflteringin haBjware . For ^ 
form fi.ter of Flg . . . m one Cock cycle, several inpu, ^ „ ^ to ^ ^ 
.ample (-put ^ pipelMllg) . Fig . 3 ^ ^ fc ^ rf ^ * 

samples, inputfor ompuf, are cmn puted fa ^ c]ock . „ fc 

Q ™ a ° ae ' ™> fe *« m -P>« «*- a common from four ^ 

Zw 1 8 ^ ° f (Ui ~ ta 3B) " ^ *- ^ -P><= * Zeroed 
me mput samples am also shifted one posmon. Using an upscaling mtio of 1 :2 (Fig 3A) 

every «wo otapu, samp.es me mpu, samp.es am shifted opposition. *> Fig. 3, honzjov 

me mpu, sample number is Moated, and vemoaUv the o„«pu, samp,e number is indicated 

/"* , ™^** e ^^ffl««ofFig2canb* lB edFig4m OStatos 
me wmlong of ,hrs fiber naing vernca, line, Bach c,oc k computes me camion of a 

smgJe mpu, sample «o mom ou«pu, samples (omput sampie pipehtmtg). Also in thia fig. a FW 

of fbu, » shown: an mpu, samp,e cm.Mbu.es to four output sample, Using a muo of. a 

£rg4B) means ma, an output sampie has received a comribuuon fiom eight inpu, samp.es 

m to te.a,memomem rtB oemgc^,fimnmefi Jter .Wimamfi„of... ( Fig4A)meL 
ma, an ^ samp.e has mceived a contnbmmu fiom four mput samp.es in to W a, me 
moment it is heing output from the filter. 

^^^^^^appHedmtheomersituatioumommumpliemmat. 
requu*. for me filter width wollW be ueeded if quabty was to be maimahmd 

fl *ki . .. 5 iBu ^ aastembo *»^ wording to the invention ma, supports 
fie* e tag h quatity up and down scaling. Tne number of s^p.es operated on in a cyC 
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driven for upscahng and input (clock-) driven for downscaling. Consequently file fit* \* 

forther includes an output pineline OP with «. 1+1 ' ltxe mter 

storing a discrete hJL!T / ^ *** ^ DOi ' -* for 

«ng a discrete representation (sample) (shown are four output delay cells) In between 

10 each sequential pair of output delay cells DO- and DO .<= 

j j. 1 1J(J i+i is a summating elements <j. ««. 

delay cell DOh-i or an output etching neuvork DSN for accumulating ou»ut values Iron, 
the summaUng events. Tnc pipelinB IJT^t 

^^^^^^Minau^erauunar.wnennonewu^Ce? 

niclude a switching element for rlmwi™ ^- oi me taps 

9n +K t t g element tor directing a discrete representation from an input tan noint 

where i <=i Pi„ < .i. 7 P pomt ^ to a summating element Si, 

where j <=,. Fig. 5 shows three switching elements SW 2 SW 3 and SW w * , 

mng network ISN for stalling input values in the input delay cells DB Th .« 

output samples are generated at a higher frequency. 
3 111 toe embodiments shown in Res 5 a**, rt.* 

also be located in between the multinhe^anHAoo. • , cements may 

Fie 7 wW* • *u P md * e Summann S dements. This is illustrated in 

Fig. 7, which m other aspects corresponds to Fig 6 
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Fig. 8 shows an alternative embodiment where the switching elements S Wi are 
integrated into a switching network (multiplexing layer, indicated as MUX) that may support 
more switching options than required. 

Fig. 9 shows a further embodiment including a delay element DI X and a 
subtracting element SUB. The current input sample and the immediately preceding input 
sample (supplied by the delay cell Dfc) are subtracted from each other. The outcome of the 
subtraction is fed into the inputpipeline IP. In this way, the filter does not operate on 
absolute sample values but on relative sample values. In particular, if the input signal is 
constant for a certain sequence of input samples (a DC signal) the core filter will provide a 
'0' output. In the embodiment of Fig. 9 the delayed input element is subtracted from the 
current input sample. An absolute input sample is added to the output of the output pipeline 
to give the actual output sample, using a summating element S 0 . In Fig. 9, the input sample 
stored in delay element DI, is added to the output sample. In an alternative embodiment 
shown in Fig. 10 the current input sample is added to the output sample. It will be 
appreciated that in the embodiments of Figs. 9 and 10, the main purpose of DI, is to create a 
relative input signal. A further input delay element may be added to the input pipeline to 
complete the input switching network. This additional input delay element including 
feedback switch can be the same as shown for DI, to DI 4 of Fig. 6. It would be positioned 
after the input subtracter SUB and before the first tap Ti. 

Fig. 10 provides more details of the filter as shown in Fig. 9 with the switching 
elements of Figs. 5 and 6. It shows that filter coefficients are supplied to the multipliers M, 
Preferably, each multiplier M ; is associated with a respective coefficient matrix Q to enable 
polyphase filtering. For each filter phase, a different coefficient can be supplied to the 
multiplier for multiplication with an input sample. In itself, polyphase filtering is known and 
will not be described further. 

In a preferred embodiment, the FIR filter device according to the invention 
includes a controller for controlling the filter device based on a state machine. The state 
machine may control any (preferably all) of the following aspects: 

- clocking of the input pipeline and/or output pipeline (via an input enable and output enable 
signal, respectively), 

- selection of a coefficient from the coefficient matrices Q, and/or 

- a setting of the switching elements SW S (via a respective xsel, signal), 

- a setting of the output switching network OSN, 

- a setting of the input switching network ISN. 
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Ftg. 12 *■ nrdtcaed whrch sampies are added to the output pipeline. As f„r Kgs . 3 and 4 
ft ^ samples ^ ^ ^ veraoaiiy ^ - 
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Fi \ 12 * a,<he Stotemachtoetas «* shaes fbrafflter widthof 4 
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output samples, corresponding m Fig. S. Sfcte 8 represent the case wherein FW hmuV 

^-n^pedontoFWou^aan^lea.Sineen.epipenned inpu, and .^ntLpiea 
have the reason that they am conaee^e, the number ofp^ibihL ean oT ^ 
mathemaucaijy computed. Each consecuuve mdnpiicanon a muWpUer opem.es „ n enter the 

LtL ™ r ^ mUWpH — ««* - - either one of I two 

atoWof2 ^^^-^in^^w^^^^^^^ 
number of possibilities (i.e. the number of disunc, ^ 

cho,ce). Mumpher M, can aelectivety receive an input sample tarn TT 2 fi e then- 

-s.ecnveiy receive an input s^e from TP 3) TP 2 , or TPi. However, it 

Slter operas on a conserve sequence of fcpn, aamp.es, no -holes- should occm (e^ 

M 1 for M, or *e same one aa being ae,ec,ed for M, SimilaHy, M, haa a theoretic choice 

"^^-------ionainput^e 
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Since Ihe cases are fixed for any predetermined FW it is most feasible to 
implement this in a finite state machine (FSM). Each state is followed either by itself or by 
another state so rules can be set up on state transitions. As will be described in more detail 
below, the transitions depend on the on forehand computed m lmv and m m of the output 
samples. 

Fig. 13 illustrates the state transitions for state 2. In every state, like state 2, 
three different transitions are possible (indicated as a, b and c). Transition a is done under'the 
condition that the oulput sample is not finished (as will be described below: m Mgh has not 
been reached). In this case the state remains the same, a new input sample is requested, no 
new output sample. Transitions b or c are done if m Mgh has been reached, so not state a. The 
decision for b or c depends on m Jow of the new output sample. In each of these two transitions 
apart from processing a new output sample also a new input sample is requested (this is not 
generally the case). Fig. 13 shows the current state (in this example state 2) as the left block. 
The three other blocks show the state that is reached after transition a, b, or c, respectively. 
For each block the state number is indicated in the upper left corner. So, Fig. 13 shows the 
following state transitions: 

a : 2 -> 2 

b: 2 -o 5, and 

c: 2 ->3. 

Using this notation no arcs need to be shown, although in Fig. 13 they are shown to illustrate 
the principle. Fig. 14 shows all transitions for all eight states. 

The state machine's output controls the scaling engine topology (which input 
samples contribute with which entry of the filter table to which oulput sample including the 
request of new input samples and shifting out ready computed oulput samples. Fig. 15 shows 
for each state the condition for any of the three possible state transitions, and the resulting 
output In this example, the state machine controls the switching elements SWi via the 
respective signals xsel, (as also shown in Fig. 10), clocking the input pipe line, via signal 
input-enable i_en, and clocking of the output pipeline via signal output-enable o_en. 

Fig. 16 gives an example of a panorama processing of one sample line. The 
first input samples are upscaled. For successive sample, the ration is slowly adjusted to 1:1, 
followed by downscaling in the center. Then the reverse process occurs: the ration is again' 
slowly adjusted to 1:1, followed by upscaling. This process may be controlled by any suitable 
scaling curve, such as apaiabola. 
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Each output sample receives a contribution from several input samples 
reduplicated with a filter coefficient. The firs, sample to contribute is indicated wnh «, 
the las. with All samples in between afeo conhibute thns mim and m^ botmds JL 
of mput samples for a specific output sampte. As discussed before the distence between m , 
and n, m needs not to be constant e.g., flexible (downscale) scaling ratio. The scaling ratio"' 
thus reflects itself on the distance of mim and m M * with a given FW. 

Fig. 17 shows a signal processing apparatus 1700 that includes the FIR filter 
device 17 10 for sample rate converting an image signal, such as an amho or video signal The 
•hscrete representations on which the filter operates are sampled input image signal, The 
■mage signal may already be supplied in a suitable digital form to the display apparent* „ ^ 
stgua. is pmvided in an anrtogue form, the display apparetos may include an A/D converter 
for samphng the analogue signal. A controller 1720 is used for contmlling the filter as 
described above. The conteoller .720 may be embedded in the filter device or may be 
externa, to the filter dovica (e.g. fc* g e^d on sunable processor of the signal pressing 
apparent, The sample rate converted signal may be oufcu. for finther processing by other 
Waratase, fi, the latter case, the signal may be outer., in a suitabfe digital represented via 
a smteble thgml mterfaco. Such representations and interfeces are well known. I. may also be 
converted te an analogue fornr using a D/A converter. The sample rate converted signal may 
be further processed by the signal pressing apparatos itself. For example, me signal 
processing apparetos may inciude a storage device for storing me converted signal. The 
storage may, for example, be a tepe, hard disk, or solid atete memory. The signal may be 
pmvtded from the storage to a rendering device. The rendering device may be external or 
mtemal to the signal processing apparatus. The rendering device may, for example be a 
display device 1730, such as a CRT, LCD, plasma display or a suitable other display oran 
audio rendering device (amplifier 1740 and speakers 1750). 

»*°ulobenoted.ha.,heab„ve-men^ 
Inm. the mvenbon, and ma. .hose skilled in the art will be able to desfgn mtmy alternative 
anrtodimentewiaom departing fiom me scope of fhe appended claims. In me clafma any 
reference signs placed between parentheses shall no. be construed as limiting the claim Use 
of fhe verb "comprise" and »inchrde» and its conjugations do no. exclude the presence of 
elemems or steps otter than those stated in a claim. The article "a" or "an" preceding an 
element does no. exclude the presence of a plumBty of such elemente. The invention may be 
■mplemented by means of hardware comprising severe, distinct elements, and by means of a 
smtabfy prcgremmed computer. A computer program product may be stored/distributed on a 
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suitable medium, such as optical storage, but may also be distributed in other forms, such as 
being distributed via the Internet or wired or wireless telecommunication systems. In a 
system/device/apparatus claim enumerating several means, several of these means may be 
embodied by one and the same item of hardware. The mere feet that certain measures are 
recited in mutually different dependent claims does not indicate that a combination of these 
measures cannot be used to advantage. 
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including: 
and 



A Finite Impulse Response (FIR) filter device for sample rate converting 
-luence of discre* representations; the fiher devico ^ ^ ^erfing a 

an input pipeline IP for receiving fiie sequence of discrete representations and 
- a science of input delay cefis DI b each for storing a discrefc tepresenfction; 

.0 nrcluding: " ^ 3 S ^^" stations and 

^esemation/^ 060 ^ 

reoresentan.,,, " ' ^^"^^ eta "»* * *» ^ding a, .east «wo discrete 

—in g- J^^~« fc — 

^er~r:r.r:rrcrd^ 

representation from any tan noint TP- to a ^ , X discrete 

any tap point TP, to a summating element Si, where j <=i. 

A FIR filter device as claimed in claim 1, wherein each of the taps Tj are 
coupled to only one respective summating elements S,; fire switehiua elemer* Z l 

^^^^points^wherej^andthln™^ ^ 



25 2. 
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3. A FIR filter device as claimed in claim 1 , having a constant filter width N, N 
outout delay cells DOi, and iVor N-l input delay cells Dli. 

4. A FIR filter device as claimed in claim 1 , wherein the input pipeline includes a 
input switching network ISN for accumulating input values in the input delay cells Dlj. 

5. A FIR filter device as claimed in claim 1 , wherein each multiplier Mi is 
associated with a respective coefficient matrix Q to enable poly-phase filtering. 

6 ' A FIR filter device as claimed in claim 1 , including a controller operative to 

control the filter device based on a state machine. 

7. A FIR filter device as claimed in claim 1 , wherein the state machine 
determines at least one of the following: 

- a setting of the switching elements SWi, 

- a setting of the output switching network, 

- clocking of the input pipeline and/or output pipeline. 

8. A FIR filter device as claimed in claim 5 and 7, wherein the state machine 
determines selection of a coefficient from the coefficient matrix Q. 

9. A FIR filter device as claimed in claim 4 and 7, wherein the state machine 
determines a setting of the input switching network. 

1°- A FIR filter device as claimed in claim 1, including a further delay element 

and a subtracting element for deternuning a difference between an input discrete element and 
an immediately preceding input discrete element and supplying the difference into the input 
pipeline; and including a further summating element for adding input discrete element or the 
immediately preceding input discrete element to an output discrete element to be supplied by 
the output pipeline. 

11. A signal processing apparatus including a FIR filter device as claimed in claim 

1 for sample rate converting an input signal, where the discrete representation is a sampled 
input signal, for subsequent rendering by a rendering device. 
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A signal processing apparatus as claimed in claim 1 1 , wherein the signal 
processing apparatus includes the rendering device. 
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